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Abstract — We consider the problem of designing optimal M x 
N {M < N) sensing matrices which minimize the maximum 
condition number of all the submatrices of K columns. Such 
matrices minimize the worst-case estimation errors when only K 
sensors out of N sensors are available for sensing at a given time. 
For M = 2 and matrices with unit-normed columns, this problem 
is equivalent to the problem of maximizing the minimum singular 
value among all the submatrices of K columns. For M = 2, 
we are able to give a closed form formula for the condition 
number of the submatrices. When M = 2 and K = 3, for an 
arbitrary N > 3, we derive the optimal matrices which minimize 
the maximum condition number of all the submatrices of K 
columns. Surprisingly, a uniformly distributed design is often not 
the optimal design minimizing the maximum condition number. 



I. Introduction 

Consider a set of N sensors. These iV sensors are used 
to estimate an Af-dimensional signal, where N > M. In the 
sensor scheduling problems, to maximize the lifetime of the 
sensor network, at any single time instant, only K sensors are 
turned on to monitor the M -dimensional signal. In our system, 
we assume that each time these K sensors are uniformly 



possible subsets, so on average the 



selected from the 
lifetime of the sensor network is extended by a factor of j^. 
In hostile environments, for example, in battlefields, it is very 
common that only a limited number of sensors are able to 
survive and operate as designed. Suppose that only K sensors 
out of the N sensors are able to survive the hostile environment 
and be functional in sensing the A/-dimensional signal. For 
these application scenarios, it is helpful to maximize the worst- 
case performance of the sensing system, no matter what set 
of sensors are used or are able to survive. In this paper, we 
consider the problem of optimal sensing schemes to achieve 
such a goal. 

Suppose the signal is denoted as a vector x £ R M . Let us 
consider a sensing matrix A g R MxN . The sensing results 
of N sensors can be represented by N real numbers, each of 
which is the inner product between the signal x and a column 
of A. Let KS C {1, 2..., N}, with cardinality \KS\ = k, be 
the subset sensors that are active at a certain time. We can then 
represent the measurement matrix of the surviving sensors by 
Aks, where Aks is a M x K matrix consisting of columns 
indexed by KS from A. 

Then the i^-dimensional measurement result y 

y = a ks x + w, 

where w is the if-dimensional observation noise. 

The authors are temporarily listed in alphabetical order of their names. 



Then by the singular value decomposition, we have 

A T KS = UAV*, 

where A is a M x M diagonal matrix with the K singular 
values ax, 02, and au on its diagonal. 

Then the estimation error of x = (A ks Aks) 



satisfies 



xh = \\{A T KS A KS ) 



< 



H 



So in order to optimize the worst-case performance, we need 
to maximize the smallest singular value among all the possible 
(^) possible subsets. This introduces a problem of designing 
the measurement matrix A. To make the problem meaningful, 
we assume that each column of the measurement matrix has 
unit norm. Since each column of the measurement matrix A 
has unit norm, when M = 2, this is equivalent to minimizing 
the maximum condition number. 

In general, the condition number k(B) of a matrix B is the 
ratio of the largest singular value a max (B) and the smallest 
singular value a mm (B): n(B) = ^^fy- 

Let A = [oi, ot2, ojv]> where a%, ajv are the columns 
of A. We assume here that 1 1 ct-i 1 1 2 = 1 holds true for 1 < i < 
N. Let KS C {1, 2, N} with cardinality \KS\ = K. Now, 

let Aks be an Af x K submatrix Aks = K,ffli 2 , ,ai K ] 

with columns indices ij, 1 < j < K, from the set KS. Also 
define 



Aks = A 



KS 



K 

A KS =J2 ai i a l 



(1.1) 



Using these notations, we can describe our optimal design 
problem for the parameter set (M, N, K) as follows. 



mm 

A£R MxN with unit-normed columns 



max 

KSQ{1,2,.. 



^max(AKs) 

(Aks) 



Compared with the design of compressive sensing matrices 
satisfying the restricted isometry condition [1 1, in our problem, 
the submatrices Aks are wide matrices instead of tall matrices 
in HI. Also, the application background is very different from 
compressive sensing. 

II. Derivation of the Condition Number for M = 2 

Generally, the optimal design for an arbitrary M, N and 
K is difficult to get. The difficulty arises from the fact, we 
need to optimize the maximum condition number among („) 
submatrices. In our applications, we focus on the case of M = 
2. When M = 2, we can a concise formula for the condition 
number for a specific submatrix Aks- 
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We know that the condition number of Aks is given by 

max|| J) || =1 (?7 T 'A K sv) 



k(A ks ) = 
lumn; 

A = [ai, ci2, ajv] with 



(II. 1) 

min||^|| = i(r7 T ^iifsry) 
Since the columns of A are unit-normed, we can represent 



cos 6i 
sin 8i 



(11.2) 



for 1 < i < N, where 6 l e [0,tt). Note that shifting 0j by 7r 
does not change the condition number of any submatrix. 

Since 1 1 77 1 1 2 = 1 we can choose 

cos a 



sin a 



Thus 



A 



tFAksv = (^tfaijaj.r)}. 
3=1 



(H.3) 



And, rj T aijaj.i-] is equal to 



(cos(a) coa(fiy ) + sin(a) sin(/3 ii )) 2 
= cos 2 (a - 



After simplification, ( 1H.31 > becomes 



A" 



V T A K sV = E cos2 ( a _ 0*. 
3=1 



if 1 

y + 2 



A" 



5>os(2( a -^.)). 



3=1 



(H.4) 



Let us define 



A 



J(") = y + i$>os(2(a-#g). (1X5) 



3=1 



Then the minimum or maximum eigenvalue of Aks is 
achieved when J' (a) = 

A 

J' (a) = -2 53 sin ( 2 (" - ^ )) = °- ( IL6 ) 



We also have 



3=1 



A 



J" (a) = -4 5] cos(2(a-0y))<O (1X7) 
3=1 

at the maximum eigenvalue and the inequality is reversed at 
the minimum eigenvalue. An important observation to make 
is that a max and a min differ by §. 



When (Ef = iSin(2^)) 2 + (E J i l 1 cos(2^.)) 2 ? 0, from 
dH.61 l. the optimizing a satisfies 



A 



Ef =1 cos(2^.) 



cos(2a) 



and 



(Ef =1 sin(2^))2 + (Ef =1 cos(2^))2 



Ef=iSin(2^; 



sin(2a) = 



EjLx sin(2^))2 + (£f =1 co S (2^.))2 



From expansion of dll.5t , we get 



A 



A 



K 1 1 
•7(a) = y + -53 cos ( 2Q! ) cos(26»i. )+- 53 sin(2a)sin(20 i3 .). 

3=1 3=1 

(1X8) 

Combining the optimizing a and dll.81 l, we have 

JH = y + 

1 Eli ££1 (cos(20 I; ) coB(2fli ) + sin(2^ ) sm{2Q i} )) 



(E i l 1 sin(2(^))) 2 + (Er=iCOs(2^)) 2 



Define den 2 = (J^f =1 sin26» l! ) 2 + cos 20 h ) 2 . Then 

A 

den 2 = 53( sin2 29i > + cos2 26>i ' ) 
{=1 

A A A A 

+ 53 53 cos 2 ^ cos + E E sin 2 ^< sin 2 ^ 

3=1 «=W3 3=1 i=i 

A A 

= ^ + 2^ 5^ cos2(fl il 

3=1 J=3+l 

Similarly, we define num = XjLi Eti cos(20i,) cos(2# i:i ) + 
Ef=iE^iSin(2^)sin(2^.). 
It can be expanded as 

A A A 

num=53(sin 2 26^ + cos 2 29 tl ) + 53 53 cos 2 ^< cos 2 ^ 

i=l i=l 1=1,J#3 

A A 

+53 53 sin 2 ^< sin 2 ^- 

3=1 2=1,1*3' 

A A 

=^ + 2 E E cos2(^-^.) 
3=1 1=3+1 

Plugging den and num into dll.9t , we get 



A 



J(a r . 
and 



K 1 
7 + 2 



\ 



K 



K A 



53 53 cos2(^-^.), (H.9) 



3=1 1=3+1 



J ((Xmin ) 



K 1 
~2 ~ 2 



\ 



7a 



A A 



53 53 cos2(^-^.; 



3 = 1 (=3 + 1 

(11.10) 

Thus minimizing the condition number of Aks f° r a given 
set of indices {ii, .., %k} is the same as this optimization 
problem 

A A 

minimize 53 53 cos 2($ii — )■ (11.11) 
3=1 l=j+l 

With KS C {1, 2, iV}, the optimal sending matrix 
design problem for M — 2 can be reformulated as, 

A A 



mm 

9i,...,8 w AS= 



max 53 E c ° s2 (^ 



'3=1 /=3'+l 



3 



One can easily find the optimal solution for K = 2. 

Theorem 2.1: Let K = 2, M = 2 and let N > 2 be 
an integer. Then the set of angles 6 = {0, -j^, ^ Af ^ 7r } 
minimizes the maximum condition number over all possible 
sub-matrices with two columns. 

Proof: The optimal design minimizes the cost function 

cos2(0 i; -6^) (H.12) 

for the set of indices {11,1-2} ^ {1, 2, iV} which gives the 
largest cost function. 

Without loss of generality, we let Oi, 1 < i < N, lie in 
the range [0, n) and let 8\ = 0. In order to minimize the 
maximum condition number, we only need to maximize the 
minimum of min{|2^ ! - 2^|,2tt - (28 H - 28 tj )\}. This is 
apparently achieved with the given set of angles. ■ 

In the following sections, we will derive the optimal design 
for if = 3. 

III. K — 3, N IS AN EVEN NUMBER 

Surprisingly, unlike K = 2, the optimal matrix design for 
K = 3 is often not achieved with the uniformly distributed 
angles. 

Theorem 3.1: Let K = 3 and N be an even number. Then 
the set of angles 0t — 27r ^^ mod n, 1 < i < N, minimizes 
the maximum condition number among all sub-matrices with 
K columns. Moreover, they are the unique set of angles that 
achieve the smallest maximum condition number for N > 6. 

Proof: We first derive a lower bound for the maximum 
condition number among all sub-matrices with K = 3 
columns; and then show the given set of angles achieve this 
lower bound. 

Suppose that the set of angles < 0* < tt, 1 < i < 
N, achieve the smallest maximum condition number for all 
submatrices with K = 3 columns. Without loss of generality, 
let 9* = 0; and let 8*, 1 < i < N, appear sequentially in a 
counter-clockwise order. Let Oi = 29*, so we have < Oi < 
2tt. 

(lower bound for maximum condition number) 
We claim that there must exist an index 1 < i < N such 

that for 8i, mo d N> an d %+2) mod N> |(0(»+2) mod N ~ 

§i) mod (2tt)| < ^. Notice that |(% +2) mod jv - Oi) 
mod (2ir)\ is just the counter-clockwise region going from 6% 
to%+2) mod n- So the summation Y^ =1 1 (%+2) modf/-^.) 
mod (2n)\ = 2 x (27r) because each counter-clockwise region 
between two adjacent angles are summed twice. By looking 
at the average of these N summands, such an index i must 
exist. 

For simplicity of notations, we denote these three angles 9i, 
mod n, and 8( l+2 ) mod n as ti, t 2 and t 3 . Without loss 
of generality, we assume that = ti < t 2 < t 3 < ^ . We 
how that the smallest condition number that these three angles 
t\, t 2 , and t 3 can achieve is when t 2 = t\ or t 2 = t 3 . 

We consider the scenario where \t 3 — t\\ < ^ remains as 
a fixed constant. Define f(t 2 ) as 

f(t 2 ) = cos(ti - t 2 ) + cos(ti - t 3 ) + cos(t 2 - t 3 ). 



Its derivative is 

f'{t 2 ) = -sin(t 2 -ii) + sin(t 3 -i2) 
„ . ,t 3 +ti ,t 3 -ti 
= 2s m( — 2 *2jcos( — — ). 

So if (t 3 — ii) < 7T, the derivative f'(t 2 ) is non-positive for 
*3±*i <t 2 < *ii±*i +7r; an d it is non-negative for t -^+ir < 
t 2 < *2±ti + 27r . So if = ti < t 2 < t 3 < % f(t 2 ) is 
minimized when t 2 = t\ or t 2 = t 3 . The corresponding f(t 2 ) 
is 

4*7T 

/(*2 = *i) = /(*2 = t 3 ) = l + 2cos(ti-t 3 ) > l + 2cos( — ). 
(Achievability) 

In order to finish the proof, we only need to show that the 
given set of angles 9i — 27r ^ 1 ^ mod n, 1 < i < N, achieve 
the lower bound 1 + 2cos(^). Let Oi = 28i, so we have 

< 6i < 2n. Counter-clockwise, starting from the two angles 
9i = and 8n +1 = (which are in fact two angles in the 
same position), we re-label these N angles sequentially as 0\, 
9 2 , and 8^. 

Namely, we need to show, for any 3 angles n, r 2 and r 3 
from the given set of angles Oi satisfy 

cos(ri - r 2 ) + cos(r 2 - r 3 ) + cos(ri - r 3 ) < 1 + 2 cos(— ). 

Without loss of generality, we assume that n, r 2 and r 3 
are in a counter-clockwise order; and assume that \(r 2 — n) 
mod (2tt) \ is the smallest among \(r 2 —r\) mod (2n)\, \ {r 3 — 
r 2 ) mod (2n)\ and \(r\—r 3 ) mod (2ir)\. Apparently, \(r 2 — 
n) mod (2n)\ < ^L, and \(r 2 — n) mod (2tt) | is an integer 
multiple of 

Suppose |(r 2 — r\) mod (27r)| = 0. Then r 2 = n and 
|(ri-r 3 ) mod (2tt)| = |(r 3 -r 2 ) mod (2tt)| > ^. Similar 
to the proof of "lower bound", for such a setting, the function 

f(r 3 ) = cos(ri - r 2 ) + cos(ri - r 3 ) + cos(r 2 - r 3 ) 

is a decreasing function of r 3 for r 3 e [n , (ri + 7r) 
mod (27r)]; and an increasing function of r 3 for r 3 e [(ri+7r) 
mod (27r), (ri + 2tt) mod (27r)]. So the maximum of f(r 3 ) 
is achieved when |(n — r 3 ) mod (27r)| = where f(r 3 ) = 

1 + 2cos(f). 

Suppose |(r 2 - r\) mod (27r)| = Then |(n - r 3 ) 
mod (2tt)| > ^ and |(r 3 - r 2 ) mod (2tt)| > ^. Similar 
to the reasoning in the "lower bound" part, the maximum 
for f(r 3 ) = cos(ri - r 2 ) + cos(ri - r 3 ) + cos(r 2 - r 3 ) is 
achieved when |(r 3 — r 2 ) mod (27r)| = r 3 ^ n; or 
— ^ 3 ) mod (27r)| = ^ and r 3 7^ r 2 . In both cases, 
f(r 3 ) = 2cos(^) + cos(^), which is smaller than the lower 
bound 1 + 2cos(^). 

Now suppose \(r 2 —r\) mod (2n)\ > Since |(r 2 — ri) 
mod (27r)| < ^ and r 3 is certainly outside the counter- 
clockwise region going from n to r 2 , using the same rea- 
soning in proving the lower bound, the function 

f(r 3 ) = cos(ri - r 2 ) + cos(r! - r 3 ) + cos(r 2 - r 3 ) 
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achieves its maximum when f3 = r 2 or r 3 = n. This 
maximum is 

f{rz = n) = 1 + 2cos(ri - r 2 ), 

which is certainly no bigger than 1 + 2 cos(4£). 

So the given set of angles indeed achieves the lower bound 
1 + 2 cos(^r), and we have proven the optimality of the given 
set of angles in minimizing the maximum condition number 
among all submatrices with 3 columns. 

(Uniqueness) 

Moreover, in the proof of the lower bound, when N > 6, 

(t 3 — ti) < 7T, the derivative f'fa) is negative for * 3 j^ 1 < 

h < -^ir 1 + 7r; and P° sitive for !l ir i + t < *2 < * a ^ 1 + 2tt. 
So ^3 = or ^3 = t2 are the only two places where f(t 3 ) 
achieves the lower bound 1 + 2cos(^). We further notice 
that the lower bound is achieved only when the counter- 
clockwise region between any 3 adjacent angles from 0j, 
1 < i < N, is equal to Otherwise, if there exist one 
set of 3 adjacent angles from such that the region between 
them is larger than 4£, there must exist another set of 3 
adjacent angles from 0j, 1 < i < N, such that the counter- 
clockwise region between them is smaller than fe. This is 

because Y^iLi l%+2) mod jv - ^1 = 2 x ( 27r )- For the se set 
of 3 angles, their corresponding cost function /(■) is larger 
than the derived cost function lower bound 1 + 2 cos(^), thus 
bringing a larger maximum condition number. This proves for 
N > 6, 9i = 27r ^ 1 - > mod tt, 1 < i < N are the unique set 
of angles that minimize the maximum condition number. 

■ 

It is worth mentioning that when N = 4, the design given 
in Theorem 13. II is still optimal. However, we have more than 
one design that can minimize the maximum condition number. 
This is because, when counter-clockwise region covered by 3 
angles is tt, no matter where the middle angle is, the cost 
function is —1. 

Theorem 3.2: For N = 4, K = 3 and M = 2, the set 
of 6 = 29 = {0i,02,0i + vr,0 2 + tt}, where < 0i < vr, 
< 02 < 7r, minimizes the maximum condition number over 
all possible 3x3 submatrices. 

IV. K = 3, N = 3 OR 5 

Interestingly, when K — 3, except for the trivial case N = 
3, N = 5 is the only other case where a uniform distributed 
design indeed minimizes the maximum condition number. 

Theorem 4.1: Let K = 3 and N = 3 or 5. Then the 
set of angles 0; = n ^ 1 ' , 1 < i < N, minimizes the 
maximum condition number among all sub-matrices with 
K = 3 columns. 

Proof: The case for N = 3 is trivial, so now we only 
focus on proving the claim for N = 5. 

For the set of angles 4 = 20, = 27r( ^~ 1) , 1 < i < JV, it 
is not hard to check that 3 adjacent angles, denoted by r\, r 2 
and r 3 , give the maximum cost function 

27T 47T 

cos(7-i-r2)+cos(ri-r 3 )+cos(r2-r 3 ) = 2 cos( — )+cos( — ), 

o o 

which corresponds to largest condition number. 



Let < 9* < 7T, 1 < i < N, be a set of N angles which 
minimizes the maximum condition number of all submatrices 
with 3 columns. For convenience, we consider the correspond- 
ing TV angles 0, = 20*, 1 < i < N. Without loss of generality, 
we assume 0i = 0; and < 0j < 2ir are arranged sequentially 
in a counter-clockwise order as i ranges from 1 to N. We first 
prove the following two lemmas before proving that there must 
exist at least 4 adjacent-3-angle sets which give the maximum 
condition number. 

Lemma 4.2: The counter-clockwise region between any two 
adjacent angles (for example 0j and 0(i+i) mo d n f° r some i 
) is smaller than tt. 

Proof: Note that the 5 angles partition the circle into 5 
regions. If instead the counter-clockwise region going from 
9i to 0(i+i) mod n is at least tt, because the other 4 regions 
occupy at most tt, there must exist three adjacent angles for 
which the two counter-clockwise regions covered by them 
is no bigger than |. For those three angles, from the same 
calculation as in Theorem l3.ll the smallest cost function these 
3 angles can achieve is 

cos(| - |) + cos(0 - |) + cos(0 - |) = 1, 

which is already bigger than the cost 2cos(^p) + cos(^ L ) 
achieved by the 5 angles 0, = 20; = 2lr{i N 1] , 1 < i < N. ■ 

Lemma 4.3: Let N — 5. In the optimal design 0;, 1 < 
i < N, consider 4 adjacent angles n, r%, r% and n, where 
they are arranged in a counter-clockwise order; and r 2 and r$ 
are inside the counter-clockwise region going from r\ to r^. 
(ri, r 2 , r^) and (r 2 , ^3^4) give the same condition number if 
and only if (r 2 — n) mod (2tt) = (ta — r$) mod {2tt). 

Proof: Without loss of generality, we assume r\ = such 
that ri, 1 < i < 4, are all within [0, 2tt). Now we only need 
to show (ri,r2,T3) and (r 2 ,r3,r4) give the same condition 
number if and only if r 2 — r\ =r^~ r$. 

If ( r i, r 2, r 3) an d (r 2 , r 3 , r 4 ) give the same condition num- 
ber, we have 

cos(ri - r 2 ) + cos(ri - r 3 ) + cos(r 2 - r 3 ) 
= cos(r 3 - r 2 ) + cos(r 4 - r 2 ) + cos(r 4 - r 3 ). 

This means 

2cos( — Yr 2 -n)cos( — - — ) 

= 2cos( — hr 4 -r 3 )cos( — - — ). 

Since we have just shown that r 3 — r 2 is smaller than tt, 
we have 

cos( — V r 2 - n) = cos( — hr 4 - r 3 ). 

This means either r 2 — r\ = r 4 — r 3 or r 4 — r 4 = 27r. 
The latter is not possible for a set of angles which achieve the 
smallest maximum condition number, because r 4 — r\ = 2tt 
forces the next angle r 5 to be aligned with both r\ and r 4 . 
This gives a condition number of cxo for the three angles r\, 
r 4 and r$. So we must have r 2 — r\ = r 4 — r 3 . ■ 

In the optimal design 0;, 1 < i < N, we assume 
that {01,02,03} is a adjacent-3-set which corresponds to the 
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maximum condition number. 

A. (At Least 2 adjacent-3- angle Sets Giving the Maximum 
Condition Number) 

Lemma 4.4: 8\, 82 and 6*3 can not be the unique set of 3 
angles that have the largest condition number. 

Proof: We prove by contradiction. Suppose {61,82, 83} 
is the unique set of 3 adjacent angles that have the largest 
condition number. Then we must have #3 — 6\ < tt. Suppose 
instead that 6*3 — 8\ = tt or #3 — 8\ > tt. 

If 83 — 61 = tt, the cost function for the set of 3 angles 84, 
82 and 6*3 is equal to the cost function for the set of 3 angles 
83, 85 and 8\ . This is a contradiction to our assumption. 

If 83 — 81 > tt, then 82 —pi =83 — 82- Otherwise, we can 
always shift 62 towards 2i±h. by a sufficiently small amount 
and strictly decrease the cost function for 9%, 82 and 83. Since 
the cost functions for any other 3 adjacent angles are strictly 
smaller than the original cost function of 8\, 82 and 83, their 
cost functions will remain smaller than the new revised cost 
function of 84, 82 and #3. So we have just decreased the largest 
condition number, which is a contradiction. So we must have 
82 — 81 =83 — 62- However the cost function for 84, 85 and 8\ 
is lower bounded by 2 cos(f ) + cos(7r) = —1, which is larger 
than the cost function for 8\, 82 and 63. This is contradictory 
to the assumption that the set of 6\, 62 and 83 corresponds to 
the maximum condition number. 

So we must have 83 — 81 < tt. In this case, if we shift 
63 counter-clockwise by a sufficiently small amount 5, we 
will strictly decrease the cost function for 64, 82 and 83. 
Since by our assumption, the cost function of any other 3 
adjacent angles were strictly smaller than the original cost 
function of {84,62,83}, their cost functions will stay smaller 
than the new revised cost function for {6i, 82, 83}. So we have 
just strictly decreased the maximum condition number of the 
optimal design, which is not possible. ■ 

B. (At Least 3 adjacent-3- angle Sets Giving the Maximum 
Condition Number) 

Lemma 4.5: {81,62,63} and {62,63,64} can not be the 
only 2 sets of 3 adjacent angles which correspond to the 
maximum condition number. 

Proof: We prove by contradiction. Suppose {61,82,63} 
and {62,83,64} are the only two sets of 3 adjacent angles 
that have the largest condition number. This means 64 — 63 = 
62 — 61 = a for some a > 0; and 62 — 61 = j3 for some f3 > 0. 
Note that 2a + (3 < 2tt because, otherwise, 64, 65 and 84 are 
forced to be in the same position, giving rise to a condition 
number of 00 for these three angles. 

From Lemma 15.21 we know (3 < tt. For such a /3, it is not 
hard to check that under the constraint 2a + (3 < 2tt, the cost 
function cos(a) + cos(/3) + cos(a + f3) achieves its unique 
minimum when 2a + f3 = 2tt. Moreover, the cost function is 
a strictly decreasing function as a grows from to TT- f. SO 
if we shift 84 counter-clockwise by a small amount 5 > and 
shift 81 clockwise by the same small amount <5 > 0, then as 
long as 2a + f3 < 2tt, this will strictly decrease the condition 
numbers simultaneously for {61,82,63} and {62,83,84}. 



Since the cost functions for any other 3 adjacent angles were 
strictly smaller than the original cost function of {81, 82, 83}, 
their cost functions will stay smaller than the new revised cost 
function of {81,82, 63}. So we have just strictly decreased the 
maximum condition number, which is a contradiction to our 
assumption of an optimal design. ■ 

By symmetry, in the same spirit, we have 

Lemma 4.6: {81,62, 63} and {61,62,65} can not be the 
only 2 sets of 3 adjacent angles which have the largest 
condition number. 

We can also prove: 

Lemma 4.7: {81,62,63} and {63,64,65} can not be the 
only 2 sets of 3 adjacent angles which correspond to the 
maximum condition number. 

Proof: Again, we prove by contradiction. Suppose 
{81,82,83} and {83,64,65} are the only two sets of 3 adjacent 
angles that have the largest condition number. 

We first assume that 65 — 83 ^ tt. 

We claim that if 6*5 - 83 > tt, then 64 = ^±^. This is 
because otherwise, we can shift 84 toward the middle point 
03 + 65 by a sufficiently small amount, thus strictly decreas- 
ing the condition number for {83,84,85}. This will leave 
{81,82,83} as the unique adjacent-3-set with the maximum 
condition number, which is not possible by Lemma 14.41 

But if 85 — 83 > tt, we must have 83—84 < tt. However, then 
{64,62,83} and {83,64,85} can not have the same condition 
number. In fact, from analyzing the cost function, when 6*3 — 
8 1 <tt, 65-83 > tt and 84 = ^±I&, {83, 64,65} has a strictly 
smaller condition number than {84, 6 2 , 83}. 

So when 65 — 83 ^ tt, we must have 85—63 < tt and, 
symmetrically, 6*3 — 8\ < tt. Then 84 = 83 or 65; 82 = 8\ 
or 6*3; and 83 — 84 = 85 — 83. This is because, if 84 ^ 63 
and 64 ^ 85, we can always shift 64 towards whatever is 
closer to 84 among 6*3 and 85. This will strictly decrease the 
corresponding cost function, and leaving only one adjacent- 
3-angle set having the maximum condition number, which is 
not possible by Lemma 14.41 

But then by increasing 83 — 84 = 65 — 83 by a suffi- 
ciently small amount 5 > 0, we will strictly decrease the 
condition numbers for {64, 82, 83} and {83,84,85}. Since the 
cost functions for the other sets of 3 adjacent angles were 
strictly smaller than the original cost function of {61,62,83} 
and {83,64,65}, their cost functions will remain smaller than 
the new revised cost function of {63,84,85}. So we have 
just decreased the maximum condition number of the optimal 
design, which is not possible. 

We now consider the possibility that 85 — 63 = tt. Because 
{6*3, 84, 85} and {6*1, 82, 83} both have the maximum condition 
number; and (#3 — 81) + (85 — 63) < 2tt, with the cost function 
cos(a) + cos(/3) + cos(a + f3) achieving the minimum — 1 
when a + f3 < tt we must have 83 — 81 = tt too. Then 85 
and 6*i must be in the same position, and so {84, 62,65} must 
have a condition number no smaller than {64,62,63} since 
cos(6 ) 2 — &i ) + cos(6'i — 85 + 2tt) +cos(6 , 2 — 85 + 2tt) achieves its 
minimum —1 with 8 2 = tt when # 2 < tt. This is contradictory 
to our assumption that {64,62,63} and {63,84,65} are the 
only 2 sets of 3 adjacent angles which have the maximum 
condition number. ■ 
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By symmetry, we can also prove 

Lemma 4.8: {64, #2, 6*3} and {64,95,61} can not be the 
only 2 sets of 3 adjacent angles which have the largest 
condition number. 

C. (At Least 4 adjacent-3-angle Sets Giving the Maximum 
Condition Number) 

Now we consider the cases where more angle sets have the 
maximum condition number. 

Lemma 4.9: {61,62,83}, {62,63,64} and {63,64,65} can 
not be the only 3 sets of 3 adjacent angles which have the 
largest condition number. 

Proof: We prove by contradiction. Let us assume 
{61,62,63}, {62,63,64} and {63,64,65} are the only 3 sets 
of 3 adjacent angles which have the largest condition number. 
Apparently, 6 2 - 6\ = 64 - 63 — a and 63 - 6 2 = 65 - 64 — (3 
for some a > and /3 > 0. 

We must have a + (3 < n. Otherwise, angle #5 will be in the 
same position as 8\. But, as argued in Lemma l4~7l this implies 
{65,61,62} can not have a smaller condition number than 
{61,62,63}, which is a contradiction to the assumption that 
{61,62,63}, {62,63,64} and {63,64,65} are the only 3 sets 
of 3 adjacent angles which have the largest condition number. 

So we can always increase a and j3 by a sufficiently small 
amount 5 to decrease the condition number for {61,62,63}, 
{62,63,64} and {#3, #4, #5}. Since the cost functions for any 
other 3 adjacent angles were strictly smaller than the original 
cost function of {61, 62,63}, {6 2 , 63, 64} and {63, 64, 65}, their 
cost functions will remain smaller than the new revised cost 
function of 9\, 62 and #3. So we have just decreased the 
maximum condition number, which is a contradiction to our 
assumption. ■ 

We also have: 

Lemma 4.10: {61,62,63}, {62,63,64} and {64,65,61} can 
not be the only 3 sets of 3 adjacent angles which have the 
largest condition number. 

Proof: Again, we prove by contradiction. Suppose that 
{61,62,63}, {62,63,64} and {84,65,61} are the only 3 sets 
of 3 adjacent angles which have the largest condition number. 

Firstly, we assume that the counter-clockwise region be- 
tween angle 64 and angle 61 is smaller than tr. Then we know 
angle 65 must be in the same position as angle 64 or angle 
0i. Otherwise, as we discussed earlier, we can always shift 85 
such that the cost function for {04, 05, 0i} is decreased, which 
will reduce us to the scenario in Lemma 14.51 

Suppose 5 is in the same position as angle 4 . From our 
assumption, the cost function for {03,04,05} is smaller than 
the cost function for {02, 03, 04}. This is not possible, because 
04 — 03 < it, and 65 — 64 = and the cost function for 
{62,63,64} is maximized when 62 = 63 under the condition 
62 < 63. 

By symmetry of #5 with respect to 64 and 61, when #5 is 
in the same position as 61 , we also get a contradiction. 

Secondly, we assume that the counter-clockwise region 
going from 64 to 61 is equal to it. In this case, the cost 
function for {85,81,84,} does not depend on the location of 
angle #5. Since the cost function for {6*4, 6*5, 64} is — 1 and 



64 - 6 X , in order for {8 X , 6 2 , 63}, {6 2 , 63, 64} and {64,85,81} 
to have the same cost function, we must have 6 2 = 9± = 
and 63 — 64 = ir. This is contradictory to the assumption that 
{62,63, 64} has a larger cost function than {6*3, 64, 65}. 

Thirdly, we assume that the counter-clockwise region going 
from 64 to 61 is larger than tt. Similar to earlier analysis for the 
case that , 65 must at the middle point of the counter-clockwise 
region going from 64 to 6%. However, we get a contradiction 
because the cost function for {6*4,6*5,^1} is no bigger than 
— 1; while the cost function for {61,62, 63} is bigger than —1 
since 63 — 6i < n. 

So in summary, we have proven this lemma. ■ 

In the same spirit, we can prove 

Lemma 4.11: {61,62,63}, {63,64,65} and {65,61,62} can 
not be the only 3 sets of 3 adjacent angles which have the 
largest condition number. 

Lemma 4.12: {61,62,63}, {63,64,65} and {64,65,61} can 
not be the only 3 sets of 3 adjacent angles which have the 
largest condition number. 

So the only left four possibilities are 

• {61, 62 ,63}, {62,63,64}, {63 ,64,65}, and {64 , 65 , 61 } are 
the sets of 3 adjacent angles which have the largest 
condition number. 

• {61, 62 ,9 3 }, {02,01,05}, {61 ,65,64}, and {6» 5 , 64 , h } are 
the sets of 3 adjacent angles which have the largest 
condition number. 

• 62 ,63}, {62,63,64}, {63 ,64 , 65 }, and {65 , 61 , 62 } are 
the sets of 3 adjacent angles which have the largest 
condition number. 

• {01, 62 ,63}, {62,63,64}, {64,65,61}, and {9 5 , 9i , 9 2 } are 
the sets of 3 adjacent angles which have the largest 
condition number. 

These four cases are symmetric to each other, so we 
consider the first case and the conclusion carries over to the 
other three cases accordingly. 

The first case implies that 6*2 — 0i = 6*4 — 6*3 = 6>i — 6*5 + 27r = 
a for some constant a > 0; and 6*3 — 2 = 9 5 — 9 4 = (3 for 
some constant (3 > 0. 

We note that {61,62,65} are adjacent 3 angles with a 
between 61 and 62, and a between {81 and 6*5}. We also notice 
that a > (3 > (because a + (3 < n and 2a + {3 < 2n. Under 
these constraints, it is not hard to check that the cost function 
cos(a) + cos(a) + cos(2a) for {6*5, 61, 82} is bigger than the 
cost function cos(a) + cos(/3) + cos(a + f3) for {6*1, 82, 83} if 
and only if a > (3. ) and 3a + 2(3 — 2tt. In order to minimize 
the largest condition number, we should make the cost function 
cos(a) + cos(/3) + cos(a + (3) as small as possible. 

Under the constraints that a > (3 > and 3a + 2(3 = 2tt, 
we have < a < ^p. Within this range, the cost function 
cos(a) + cos(/3) + cos(a + /3) achieves its minimum when a = 

= jr-. If a = P, the cost function is equal to 2cos(^) + 
cos(^) w -0.1910. 

So indeed the optimal solution is given by &i = n „ , 

1 < i < N. m 

V. K = 3, N = 7 

One might think that the uniform distributed design is 
optimal for N = 7 
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Theorem 5.1: Let K = 3 and N = 7 . Then 0* = ^fe^ 
mod 7r, 1 < i < N, minimizes the maximum condition 
number among all sub-matrices with K = 3 columns. 

Proof: Among 9, = 29, = 4 ^~ 1 1) mod 2tt, 1 < i < N, 
it is not hard to check that 3 adjacent angles, denoted by r\, 
T2 and T3 with r\ =r%, give the maximum cost function 

47T 

cos(ri-r 2 )+cos(ri-r3) + cos(r2-r 3 ) = 2 cos(-^r— + 

This means the submatrix corresponding to such 3 adjacent 
angles generate the maximum condition number among all 
possible 3-column submatrices. 

So in order to prove that 9i = 29i = -^fe^ mod 2tt, 
1 < i < N, minimizes the maximum condition number 
among all 3-column submatrices, it is enough to show 9i = 
= A7r ^7^ mod 2n, 1 < i < N, minimizes the maximum 
condition number among all the adjacent-3-angle sets. Let us 
assume that N angles < 9 = 29* < 2tt, 1 < % < N 
achieves the smallest maximum condition number among all 
the adjacent-3-angle sets. Without sacrificing generality, let 
B\ = and Oi be arranged sequentially in a counter-clockwise 
order as i goes from 1 to N. 

Lemma 5.2: In the optimal design 9i, 1 < i < N, the 
counter-clockwise region covered by any three adjacent angles 
is no bigger than tt for N = 7; and smaller than tt for N > 9. 
The only scenario where the counter-clockwise region covered 
by one adjacent-3-angle set is tt is when N = 7 and the 7 
angles are respectively 0, 0, 7r/2, tt/2, tt,it and ^ (up to 
rotations of these angles). 

Proof: Suppose instead in the optimal design, the counter- 
clockwise region covered by some three adjacent angles r\, r 2 
and r% is larger than 7r. Then there must exist 3 adjacent angles 
for which the counter-clockwise region covered by them is 
smaller than -J?^- < -| because the sum of the counter- 
clockwise regions covered by all the 3 adjacent angles is An 
(Please see the proof in Theorem 13. W . This means that the 
cost function for n, r 2 and r$ is larger than 2cos(-^ L j) + 1 
(when r 2 is aligned with r\ or r 3 ). Note that, 2 cos(-^r) + l is 
equal to the maximum cost function 2 cos(-^j-) + 1 given by 
the to-be-proven optimal design §i = 26i = 4 ^'_ ) ~ L L - ) mod 27r, 
1 <i < N, when N = 7; and is bigger than 2 cos( 1 ^ T ) + 1 
when > 9. This is contradictory to our optimal design. So in 
the optimal design §i = 26i = 47 ^' +1 1 ' 1 mod 2tt, the counter- 
clockwise region covered by any three adjacent angles is no 
bigger than tt for N > 7. 

When N — 7 and the counter-clockwise region covered by 
one adjacent-3-angle set is tt, the counter-clockwise region 
covered by each one of the other adjacent-3-angle sets is 
forced to be The only way for that to happen is that the 7 
angles 6 h 1 < i < N, are 0, 0, tt/2, tt/2, 7r,7r and ^ (up to 
rotations of these angles). 

Note that the same argument can show that the counter- 
clockwise region covered by any three adjacent angles is 
smaller than tt for N > 9. ■ 

In the optimal design 9i, 1 < i < N, there are N sets 
of 3 adjacent angles, and we denote each set by its counter- 
clockwise central angle. For example, we denote the set of 
three angles {0y_i) mo d JV,^,%+i) mod n} for some 1 < 



j < N as its central angle {0j}. We assume that 9\, 9^ and 
6*3 are three angles which correspond to the largest condition 
number. 

We now prove the following lemma: 

Lemma 5.3: In the optimal design 0,, 1 < i < N, N > 
7, there do not exist > 2 consecutive adjacent-3-angle sets 
(for example {9j} and {0y+i) mod n} f° r some 1 < j < 
N) which have smaller condition numbers than the maximum 
condition number. 

Proof: We prove by contradiction. Suppose that for some 
j, {9j} and {9^^ mo( j n} both have smaller condition 
numbers than the maximum condition number. We also as- 
sume that one of {%_!) mo d n} and {% +2 ) mod n} is an 
adjacent-3-angle set corresponding to the maximum condition 
number. Notice that we can always find such a j if there 
exist > 2 consecutive adjacent-3-angle sets which have smaller 
condition numbers than the maximum condition number. 

By Lemma 15721 any adjacent angle widths 71 and 72 satisfy 
71+72 < 7T. The cost function for cos(7i)+cos(72)+cos(7i + 
72) strictly decreases if we increase 71 and 72 simultaneously 
by a sufficiently small amount. 

Suppose that {9j} spans two regions with counter-clockwise 
angle width a > and j3 > 0; and that {9(j+i) mod n} spans 
two regions with counter-clockwise angle width f3 and 7. 

If j3 > 0, we can always reduce (3 by a sufficiently small 
enough amount and increase every region involved in all the 
adjacent-3-angle sets corresponding to the maximum condition 
number by an appropriate small amount such that the angle 
widths of the TV regions still sum up to 2tt. In this way, we 
have just strictly decreased the maximum condition number 
among all the adjacent-3-angle sets. This is contradictory to 
the optimal design assumption. 

If /3 = 0, since every two adjacent angles are no more 
than 7T apart, {Q(j-\) mod n} has no bigger condition number 
than {9j } and {9^ +2 ) mod n} has no bigger condition number 
than mod n}- This is contradictory to the assumption 

that {9j} and {0(j+i) mod n} both have smaller condition 
numbers than the maximum condition number; and one of 
mod at} and {9~ u+2 ) mod n} is an adjacent-3-angle 
set corresponding to the maximum condition number. ■ 

Lemma 5.4: Let N = 7. Suppose 9i, 1 < i < N, is an opti- 
mal design which minimizes the maximum condition number 
among all adjacent-3-angle sets. Then there exists at most 1 
adjacent-3-angle set which has smaller condition number than 
the maximum condition number among all adjacent-3-angle 
sets. 

Proof: We prove this lemma by contradiction. 
Without loss of generality, suppose that {0i] has a condition 
number smaller than the maximum number and there exist > 2 
adjacent-3-angle sets which have smaller condition numbers 
than the maximum condition number among all adjacent-3- 
angle sets. Then there must exist a sequence of consecutive 
angles, say 9i, 1 < i < I, for some 3 < I < N, such that any 
adjacent-3-angle set {9j}, 2 < j < I — 1 has the maximum 
condition number while the first counter-clockwise adjacent-3- 
angle set {$;} and the first clockwise adjacent-3-angle set {6*1} 
have smaller condition numbers than the maximum condition 
number. 
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Since {Oj}, 2 < j < I — 1, have the equal maximum con- 
dition number, the counter-clockwise regions between {Oj}, 
1 < j < I must alternate between a > and /3 > 0, where 
a + (3 < tt. Without loss of generality, we assume that a > j3. 
For now we also assume that a + (3 < tt. From 15.21 when 
a + (3 = tt, only 1 adjacent-3-angle set has a smaller than the 
maximum condition number. 

We first consider the case where / is an odd number,namely 
we have an even number of regions between angle 0\ and 
angle 0i . Since a + (3 < tt, we claim that f3 must be equal to 
0. Suppose instead (3^0. Then we can shift the even-number- 
indexed angles {Oj}, 1 < j < I, counter-clockwise by a suffi- 
ciently small amount. This will strictly decrease the condition 
numbers for {Oj}, 2 < j < I — 1. Since {0i} and {0\} also 
have strictly smaller condition numbers than the maximum 
condition number, thus we have > 2 consecutive adjacent-B- 
angle sets which have the smaller condition number than the 
maximum condition number. This forms a contradiction by 
Lemma 15.31 

So we must have (3 = 0. However, this implies 
{0(i+i) mod jv} has a condition number no bigger than that 
of {0i}. Thus we have two consecutive adjacent-3-angle 
sets {0i} and {#(;+!) mo d n} which have smaller condition 
numbers than the maximum condition number. This forms a 
contradiction by Lemma 15.31 

We then consider the case where I is an even number. Since 
I > 3, such a number can only be I = 4 or I = 6. 

When I — 4, then {6*6} must also have a smaller condition 
number than the maximum condition number. This is because, 
from Lemma l5~3l {6*5} and {6*7} can not have smaller condi- 
tion numbers than the maximum condition number. Moreover, 
if {0a} also has the maximum condition number, {Oj mo( j at}, 
4 < j < N + 1, are then consecutive angles such that {6*5}, 
{0e} and {6*7} all have the maximum condition numbers, 
which is not possible by our previous discussion of the cases 
when I is an odd number. 

However, when {0q} has a smaller condition number than 
the maximum condition number, there are an even number (in 
fact, 2,) of regions between angle O4 and angle 0q, which is 
not possible by our previous discussion. 

So in summary, the original assumption of > 2 adjacent- 
3-angle sets having larger than maximum condition number 
cannot hold. There exists at most 1 adjacent-3-angle set which 
has smaller condition number than the maximum condition 
number. 

■ 

If every adjacent-3-angle set has the same condition number 
as the maximum condition number, then the region between 
every angle must be equal. So the cost function for the 
maximum condition number should be 2cos(^ L ) + cos (4^). 

If there is exactly 1 adjacent-3-angle set which has a smaller 
condition number than the maximum condition number, and 
{6>i} is the unique adjacent-3-angle set that has the smallest 
condition number, then 6i, 1 < i < 7, can be respectively 
denoted by 0, a, a+/3, 2a+/3, 2(a+/3), 3a+2(3, and 3a+3/3, 
where a > 0, (3 > and a > (3 and 4a + 3/3 = 2-7T. The cost 
function for the maximum condition number cos(a)+cos(/3) + 
cos(a + (3) is thus minimized when (3 — and a = =?- for 



ct > 0, j3 > and a > j5 and 4a+3/3 = 2-k. This cost function 
is smaller than the cost function of 2cos(^ L ) + cosf^), so 
0i = Hv~pi mod 2-7T, 1 < i < N is indeed the optimal 
design. ■ 

VI. K = 3, N > 9 is an Odd Number 

Theorem 6.1: Let K = 3 and N > 9 be an odd number. 
Then the set of angles 6^ = 27 ^ 1 1 ' 1 mod n, 1 < i < N, 
minimizes the maximum condition number among all sub- 
matrices with K = 3 columns. 

Proof: The proof of this theorem follows the proof of 
Theorem 15.11 The complication compared with Theorem 15.11 
comes from the fact that we need to prove the following lemma 
instead of Lemma 15.41 

Lemma 6.2: Let us take N > 9. Suppose that 0i, 1 < 
i < N, is an optimal design which minimizes the maximum 
condition number among all adjacent-3-angle sets. Then there 
exists at most 1 adjacent-3-angle set which has a smaller 
condition number than the maximum condition number among 
all adjacent-3-angle sets. 

Proof: We prove this lemma by contradiction. 

Suppose that there exists > 2 adjacent-3-angle sets which 
have smaller condition numbers than the maximum condition 
number among all adjacent-3-angle sets. From Lemma 15.31 
we can always partition the angles into distinct blocks 
by using Oj's with {0j} having a strictly smaller condition 
number than the maximum condition number as the boundary 
angles between different blocks. From Lemma 1531 there must 
exist at least one angle between two boundary angles. Without 
loss of generality, suppose 0\ and 9i, 3 < I < N, are two 
neighboring boundary angles. Since {0j}, 2 < j < I — 1, have 
the equal maximum condition number, the counter-clockwise 
regions between {0j}, 1 < j < I must alternate between a > 
and (3 > 0, where a + (3 < tt according to Lemma 15.21 

We first consider the case when I is an odd number, namely 
we have an even number of regions between angle 0\ and 
angle Without loss of generality, we assume that a > (3 
when I is an odd number. Since a + f3 < tt, from the same 
reasoning as in the proof of Lemma 15.41 we know this is not 
possible. 

We then consider the case when I is an even number. If I 
is an even number, we divide into two scenarios: a > (3 or 

a<(3. 

If a < (3, we can simultaneously shift the even-numbered 
angles 0j, j = 2, 4, 1 — 2, clockwise by the same sufficiently 
small angle 8 > 0. Note that this shift will not increase the 
maximum condition number if S is sufficiently small. However, 
this will create two consecutive adjacent-3-angle sets {6*2} 
and {6>i} which have smaller condition numbers than the 
maximum condition number. According to Lemma 15.31 this 
is contradictory to our assumption of an optimal design. 

We now assume a > f3 and the number of regions in each 
block is an odd number. Consider two neighboring blocks 
separated by a single angle j such that {0j} is an adjacent- 
3-angle set which has a smaller condition number than the 
maximum condition number. Suppose that the second block 
is in the clockwise direction of the first block. The counter- 
clockwise region in the first block alternates between a and 



/?; the counter-clockwise region in the second block alternates 
between u\ and P\ with ot\ > Pi (otherwise we are done by 
the discussion in last paragraph). Since the adjacent-3-angle 
sets inside each block have the maximum condition number, 
without loss of generality, we have ot\ < a, and Pi > j3. If 
we change the regions of the 2-nd block to be Pi, a-y, Pi, ot\, 
ot\, and a\. Since ot\ < a and Pi > /3, in this change, 
we do not increase the condition number of {Oj}. It is not 
hard to check that as long as a% + Pi < n, the cost function 
cos(ai) + cos(ai) + cos(2ai) is smaller than the cost function 
cos(ai) + cos(/3i) + cos(ai + /3i). So in this change, we do 
not increase the maximum condition number among adjacent- 
3-angle sets, while creating two consecutive adjacent-3-angle 
sets at the clockwise end of the second block, which is a 
contradiction from Lemma 15.31 

So in summary, there exists at most 1 adjacent-3-angle 
set which has smaller condition number than the maximum 
condition number. 

■ 

So in the optimal design, the angles must alternate like a, 
P, a, 0, a, where a > P, and ^-a + ^P = 2tt. For 
N > 9, the optimal angle allocation for a is and P = 0. 

■ 

VII. Conclusion and Future Work 

We propose the problem designing optimal M x N (M < 
N) sensing matrices which minimize the maximum condition 
number of all the submatrices of K columns. Such matrices 
minimize the worst-case estimation errors when only K sen- 
sors out of N sensors are available for sensing at a given 
time. When M — 2 and K = 3, for an arbitrary N > 3, 
we derive the optimal matrices which minimize the maximum 
condition number of all the submatrices of K columns. It is 
interesting that minimizing the maximum coherence between 
columns does not always guarantee minimizing the maximum 
condition number. 
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